Papers with generative retrieval models
Re3val: Reinforced and Reranked Generative Retrieval (2024.findings-eacl)
Copied to clipboard
| Challenge: | generative retrieval models encode pointers to information in a corpus as an index within the model’s parameters. |
| Approach: | They propose a generative retrieval model that leverages contextual information to rerank retrieved page titles and utilizes REINFORCE to maximize rewards generated by constrained decoding. |
| Outcome: | The proposed model can't be tuned for the downstream readers as decoding the page title is a non-differentiable operation. |
On Synthetic Data Strategies for Domain-Specific Generative Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Generative retrieval models can be used to generate ranked lists of potentially relevant document identifiers for a user query. |
| Approach: | They propose a synthetic data generation strategy for a two-stage training framework that focuses on learning to decode document identifiers from queries and a strategy for mining hard negatives based on initial model's predictions. |
| Outcome: | The proposed model can generate ranked lists of potentially relevant document identifiers for a user query and then refine ranking through preference learning. |
Nonparametric Decoding for Generative Retrieval (2023.findings-acl)
Copied to clipboard
Hyunji Lee, JaeYoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vladimir Karpukhin, Yi Lu, Minjoon Seo
| Challenge: | Existing text retrieval models depend on the information encoded in its parameters without external memory, its information capacity is limited and fixed. |
| Approach: | They propose a nonparametric decoding approach which uses external memory instead of vanilla vocab embeddings as decoder voka embedds. |
| Outcome: | The proposed model can utilize parametric and nonparametric space. |